Towards Automatic Evaluation of Health-Related CQA Data
نویسندگان
چکیده
The paper reports on evaluation of Russian community question answering (CQA) data in health domain. About 1,500 question– answer pairs were manually evaluated by medical professionals, in addition automatic evaluation based on reference disease–medicine pairs was performed. Although the results of the manual and automatic evaluation do not fully match, we find the method still promising and propose several improvements. Automatic processing can be used to dynamically monitor the quality of the CQA content and to compare different data sources. Moreover, the approach can be useful for symptomatic surveillance and health education campaigns.
منابع مشابه
Towards Personalized Activity Level Prediction in Community Question Answering Websites
Community Question Answering (CQA) websites have become valuable knowledge repositories. Millions of internet users resort to CQA websites to seek answers to their encountered questions. CQA websites provide information far beyond a search on a site such as Google due to (1) the plethora of high quality answers, and (2) the capabilities to post new questions towards the communities of domain ex...
متن کاملCharacterizing Health-Related Community Question Answering
Our ongoing project is aimed at improving information access to narrow-domain collections of questions and answers. This poster demonstrates how out-of-the-box tools and domain dictionaries can be applied to community question answering (CQA) content in health domain. This approach can be used to improve user interfaces and search over CQA data, as well as to evaluate content quality. The study...
متن کاملUnderstanding and Summarizing Answers in Community-Based Question Answering Services
Community-based question answering (cQA) services have accumulated millions of questions and their answers over time. In the process of accumulation, cQA services assume that questions always have unique best answers. However, with an indepth analysis of questions and answers on cQA services, we find that the assumption cannot be true. According to the analysis, at least 78% of the cQA best ans...
متن کاملThe Mediating Role of Automatic Thoughts in Relationship Between Attachment Style with Sexual Dysfunction and Marital Commitment: A Path Analysis
Background: This article explores the effects of attachment style and automatic thoughts on sexual dysfunction and marital commitment, using the path analysis model. This descriptive-correlational study was conducted on 375 married female students in Shahid Chamran University of Ahvaz, Iran, from 2016 to 2017. Methods: According to Morgan and Jersey table and the statistical population (375 pe...
متن کاملMetadata-Aware Measures for Answer Summarization in Community Question Answering
This paper presents a framework for automatically processing information coming from community Question Answering (cQA) portals with the purpose of generating a trustful, complete, relevant and succinct summary in response to a question. We exploit the metadata intrinsically present in User Generated Content (UGC) to bias automatic multi-document summarization techniques toward high quality inf...
متن کامل